Amiga Format CD 52

home *** CD-ROM | disk | FTP | other *** search

/ Amiga Format CD 52 / Amiga Format AFCD52 (Issue 136, May 2000).iso / -in_the_mag- / workbench / adf / adflib / adflib.lha / Faq / adf_info.txt < prev

Wrap

Text File | 1999-05-27 | 81KB | 1,796 lines

------------------------------------------------------------------------ The .ADF (Amiga Disk File) format FAQ Laurent Clévy, laurent.clevy@alcatel.fr v1.07, 27. May 1999 ------------------------------------------------------------------------ This document describes the .ADF file format. An Amiga Disk File is a sector per sector dump of an Amiga formatted disk. The intent is to explain in detail how the Amiga stores files and directories on floppy and hard disks. A set of C routines (ADFlib) will be supplied to manage the ADF format. ------------------------------------------------------------------------ 0. Changes 1. Introduction * 1.1 Disclaimer and Copyright * 1.2 Feedback, updates * 1.3 Conventions * 1.4 Acknowledgements 2. How bytes are physically read from and written to a disk ? * 2.1 What is MFM encoding/decoding ? * 2.2 What is the MFM track format ? * 2.3 What is the MFM sector format ? * 2.4 How to decode MFM data ? 3. What is the Amiga floppy disk geometry ? 4. What is the logical organisation of an Amiga volume ? * 4.1 What is a Bootblock ? * 4.2 What is a Rootblock ? o 4.2.1 How to find the first sector of an entry ? o 4.2.2 How to list directory entries ? o 4.2.3 How to compute the checksum ? * 4.3 How are the free and used block lists managed ? * 4.4 How are files stored ? * 4.5 How are directories stored ? * 4.6 How are links implemented in AmigaDOS ? o 4.6.1 Hard links o 4.6.2 Soft links * 4.7 How are the blocks associated with the dircache mode ? 5. How does a blank disk look like ? * 5.1 A minimal blank floppy disk * 5.2 A 'Bootable' floppy disk * 5.3 A directory cache mode floppy disk * 5.4 International mode 6. The structure of a hard disks ? * 6.1 What is the Rigid Disk Block ? * 6.2 How are bad blocks managed ? * 6.3 How are partitions stored ? * 6.4 What are FSHD blocks ? * 6.5 What are LSEG blocks ? 7. The Hard file : a big floppy dump file 8. Advanced information 9. References and links 10. C Routines : the ADF Library 11. Other Amiga file systems ------------------------------------------------------------------------ 0. Changes Since version 1.06 (2. May 1999), by Heiko Rath (hr@brewhr.swb.de) : * [chg] Minor spelling corrections * [chg] Blocksizes other than 512 bytes documented * [chg] DosEnvVector extended * [add] link to the Amiga Floppy Reader project Since version 1.04 (16. January 1999) : * [chg] Corrections suggested by Hans-Joachim Widmaier (Linux affs maintainer) * [add] The WinUAE hardfile format section is starting Since version 0.9 (28. May 1997) : * [add] HTML version with figures * [add] Hard disk section added * [chg] Correction about DIRC and INTL modes (section 4.1) * [add] The whole rewritten ADF library is released (0.7.8) and used within the ADFOpus project (http://www.chromerhino.demon.co.uk/adfopus/) * [chg] The bitmap checksum algorithm is the same as the rootblock algorithm * [add] Allowed/forbidden characters in volume and file names, 4GB limit * [add] how to rename an entry ------------------------------------------------------------------------ 1. Introduction In this document, we will describe how the AmigaDOS is (was?) managing storage media, from the magnetic layer to the files and directories layer. With physical layer, I'm talking about the way bytes are physically stored on a magnetic surface, with the RLL or MFM encoding. The next layer, according to the 'most physical' to 'most conceptual' order, is the partitions layer : this is how the AmigaDOS is managing media with more then one partition, like Zip disks or hard disks. The next and last layer is the volume layer : where the files and directories are stored. The physical layer is described in the 2nd chapter, The volume layer is the biggest part of the document (4th and 5th chapters), since it's the most interesting, The partitions layer is explained in the 6th chapter. Let's continue with more conventional things in an introduction. ----------------------- 1.1 Disclaimer and copyright This document is Copyright (C) 1997-1998 by Laurent Clévy, but may be freely distributed, provided the author name and addresses are included and no money is charged for this document. This document is provided "as is". No warranties are made as to its correctness. Amiga and AmigaDOS are registered Trademarks of Gateway 2000. Macintosh is a registered Trademark of Apple. ----------------------- 1.2 Feedback, updates If you find any mistakes in this document, have any comments about its content, feel free to send me an e-mail. Corrections are very welcome. You can find new versions of this document at : * The ADFlib page (http://come.to/adflib or http://perso.club-internet.fr/lclevy/adflib/) * Aminet, in the ADFlib archive file : o ( ftp://fr.aminet.net/pub/aminet/disk/misc/ADFlib.tgz) o ( ftp://uk.aminet.net/pub/aminet/disk/misc/ADFlib.tgz) * Aminet, in a separate file 'ADFfaq.tgz': o ( ftp://fr.aminet.net/pub/aminet/docs/misc/ADFfaq.tgz) o ( ftp://uk.aminet.net/pub/aminet/docs/misc/ADFfaq.tgz) ----------------------- 1.3 Conventions In this document, hexadecimal values use the C syntax : for example 0x0c is the decimal value 12. Byte ordering Since the Amiga is a 680x0 based computer, integers that require more than one byte are stored on disk in 'Motorola order' : the most significant byte comes first, then the less significant bytes in descending order of significance (MSB LSB for two-byte integers, B3 B2 B1 B0 for four-byte integers). This is usually called big endian byte ordering. The Intel based PCs are using the little endian byte ordering. Vocabulary A 'word' or 'short' is a 2-byte (16 bits) integer, a 'long' a 4-byte (32 bits) integer. Values are unsigned unless otherwise noted. A 'block' in this document will be 512 consecutive bytes on disk, unless noted otherwise, the variable 'BSIZE' will denote the blocksize. The word 'sector' and 'block' will be used as synonyms here, even if 'sector' is usually related to the physical side, and the 'block' to the logical side. This is because the AmigaDOS can only handle one sector per block. Some other Unix filesystems can have more then one sector per block. A block pointer is the number of this block on the disk. The first one is the #0 block. There are 'logical' and 'physical' block pointers. 'Logical' ones are related to the start of one volume, 'physical' one are related to the start of a physical media. If a volume starts at the #0 physical sector, a physical pointer and a logical pointer is the same thing, like with floppies. A simple definition of 'Hashing' could be : "a method to access tables : given a number or a string, a hash function returns an index into an array". This definition is correct for this document, but there is a lot of other hashing methods, that might be far more complex. Linked lists are cell-oriented data structures. Each cell contains a pointer to the next or previous cell or both, the last cell pointer is null. C example : struct lcell { char name[10]; /* contains next cell adress, or NULL if this cell is the last */ struct lcell *next_cell; }; Block names begin with a capital (Rootblock). Field names are noted between quotes ('field_name'). All formats are described as tables, one row per field. Here is an example with the beginning of the well known GIF format : offset type length name comments ---------------------------------------------------------- 0 char 3 signature 'GIF' 3 char 3 version '87a' or '89a' 6 short 1 screen width (little endian) 8 short 1 screen height (little endian) The .ADF format is the format created and used by the -incredible- UNIX Amiga Emulator (UAE), written by Berndt Schmitt. The home page is here : http://www.freiburg.linux.de/~uae/ The .ADF files can be created with the program transdisk. ----------------------- 1.4 Acknowledgements * Hans-Joachim Widmaier for the -detailed- review and suggestions, * Dan Sutherland (dan@chromerhino.demon.co.uk) for the suggestions and ideas, * Jean Yves Peterschmitt (jypeter@lmce.saclay.cea.fr) for the review, * Thomas Kessler (tkessler@ra.abo.fi) for the bootcode flag note. * Heiko Rath (hr@brewhr.swb.de) for some modifications. 2. How are bytes physically read from / written to a disk ? The following part deals with the way the Amiga disk controller accesses the magnetic medium. If you only want to understand the .ADF format, you don't need to read this part. Information is written on disk with magnetic fields. Magnetic fields can be made 'on' or 'off'. But the read/write heads are not capable of detecting directly if a field is on or off. An encoding is used to store memory bits on the medium. The CHANGE of fields polarisation will indicate if the bit is 1 or 0. For Amiga floppy disks (and PC floppies), the encoding scheme is MFM (Modified frequency modulation). Notes on the Amiga floppy disk controller : The Amiga floppy disk controller (FDC) which is called 'Paula' is very flexible. It is capable of reading/writting Amiga/PC/Macintosh floppy disks. Paula can read a variable number of bytes from disk, the PC FDC can't. The PC FDC uses the index hole to find the beginning of a track, Paula uses a synchronization word. The Macintosh uses GCR encoding instead of MFM. In fact, Paula is simpler than the PC FDC because it does not perform automatically the decoding just after the read operation, and the encoding just before the write operation : it must be done by software. The MFM decoding/encoding is done by hardware with the PC FDC, the Amiga can do GCR or MFM decoding/encoding because it's done with the CPU. Classic PC FDCs can't read Amiga floppy disks even if they are MFM encoded on a 3.5 inch floppy, because they can not find the beginning of a track. This is why the .ADF format has been created. However, a custom FDC available on PC machines is capable of reading/writing Amiga, PC, Macintosh, Atari and C64 floppies !!! This is CatWeasel : http://catweasel.vme.de/index.html and http://www.jschoenfeld.com/eindex.html There's also the Amiga Floppy Reader Project at http://metamonkt.com/afr/ a project describing a small piece of hardware to connect to the parallel port of a standard PC, enabling it to read Amiga disks. Paula parametrization for Amiga disks : * MFM encoding * Precompensation time : 0 nanoseconds * Controller clock rate : 2 microseconds per bit cell * Synchronization value : 0x4489 Paula is able to put the read/write heads on a cylinder, and is able to read with the lower or upper side head. A track of 0x1900 words is usually read. ----------------------- 2.1 What is MFM encoding/decoding ? The MFM decoding is made by the Amiga CPU, not by Paula. This allows custom encoding, to protect floppies against copying for example. Here follows the MFM encoding scheme : user's data bit MFM coded bits --------------- -------------- 1 01 0 10 if following a 0 data bit 0 00 if following a 1 data bit User data long words are split in two parts, a part with even bits part first, followed by a part with odd bits. Once encoded, the amount of data stored doubles. The MFM decoding will transform magnetic fields into computer usuable bits. The encoding process will take one long (user's data), and produces two longs (MFM coded longs): one for the even bits of the user long, a second for the odd bits of the user long. Vice versa, the decoding process will take the half of two MFM longs to produce one user's long. ----------------------- 2.2 What is the MFM track format ? Paula will search two synchronization words, and then read 0x1900 words of data. We will call those 0x1900 words a 'MFM track'. There are 80 cylinders on a Amiga floppy disk. Each cylinder has 2 MFM tracks, 1 on each side of the disk. Double density (DD) disks have 11 sectors per MFM track, High density (HD) disks have 22 sectors. So a MFM track consists of 11/22 MFM encoded sectors, plus inter-track-gap. Note that sectors are not written from #0 to #10/21, you must use the 'info' field to restore the correct order when you read the tracks. Each MFM track begins with the first sector, and ends with the end of the last sector. Each sector starts with 2 synchronization words. The synchronization value is 0x4489. ----------------------- 2.3 What is the MFM sector format ? There are brut data and encoded data. Brut data (also called MFM data) doesn't need to be decoded, this is the synchronization data, the header checksum and data checksum. The encoded parts are 'header' and 'data'. Here it comes : 00/0x00 word 2 MFM value 0xAAAA AAAA (used for timing ?) SYNCHRONIZATION 04/0x04 word 1 MFM value 0x4489 06/0x06 word 1 MFM value 0x4489 HEADER 08/0x08 long 1 info (even bits) 12/0x0c long 1 info (odd bits) decoded long is : 0xff TT SS SG TT = track number ( 3 means cylinder 1, head 1) SS = sector number ( 0 upto 10/21 ) sectors are not ordered !!! SG = number of sectors before gap (including current one) Example for cylinder 0, head 1 of a DD disk : 0xff010009 0xff010108 0xff010207 0xff010306 0xff010405 0xff010504 0xff010603 0xff010702 0xff010801 -- inter-sector-gap here ! 0xff01090b (0xb means -1 ?) 0xff010a0a (0xa means -2 ?) 16/0x10 long 4 sector label (even) 32/0x20 long 4 sector label (odd) decoded value seems to be always 0 END OF HEADER 48/0x30 long 1 header checksum (even) 52/0x34 long 1 header checksum (odd) (computed on mfm longs, longs between offsets 8 and 44 == 2*(1+4) longs) 56/0x38 long 1 data checksum (even) 60/0x3c long 1 data checksum (odd) (from 64 to 1088 == 2*512 longs) DATA 64/0x40 long 512 coded data (even) 576/0x240 long 512 coded data (odd) 1088/0x440 END OF DATA ----------------------- 2.4 How to decode MFM data ? C algorithm : #define MASK 0x55555555 /* 01010101 ... 01010101 */ unsigned long *p1; /* MFM coded data buffer (size == 2*data_size) */ unsigned long *q; /* decoded data buffer (size == data_size) */ unsigned long a,b; unsigned long chksum; int data_size; /* size in long, 1 for header's info, 4 for header's sector label */ int count; chksum=0L; /* the decoding is made here long by long : with data_size/4 iterations */ for (count=0; count<data_size/4; count++) { a = *p1; /* longs with even bits */ b = *(p1+data_size); /* longs with odd bits : located 'data_size' bytes farther */ chksum^=a; /* eor */ chksum^=b; /* * MFM decoding, explained on one byte here (x and y will produce t) : * the MFM bytes 'abcdefgh' == x and 'ijklmnop' == y will become * y & 0x55U = '0j0l0n0p' * ( x & 0x55U) << 1 = 'b0d0f0h0' * '0j0l0n0p' | 'b0d0f0h0' = 'bjdlfnhp' == t */ /* on one long here : */ *q = ( b & MASK ) | ( ( a & MASK ) << 1 ); p1++; /* next 'even bits' long and 'odd bits' long */ q++; /* next location of the future decoded long */ } chksum&=MASK; /* must be 0 after decoding */ For example, to decode the DATA field of a MFM sector : * data_size is equal to 512, * p1 points to 64 bytes after the beginning of the MFM sector, * q points to a 512 unsigned bytes array. ------------------------------------------------------------------------ 3. What is the Amiga floppy disk geometry ? After MFM decoding, you have usuable 'sectors' or 'blocks' into memory. Here we remind the disk geometries for Double Density disks (DD) and High Density disks (HD) : bytes/sector sector/track track/cyl cyl/disk ------------------------------------------------------------------------ DD disks 512 11 2 80 HD disks 512 22 2 80 The relations between sectors, sides and cylinders are for a DD disk : Block sector side cylinder -------------------------------- 0 0 0 0 1 1 0 0 2 2 0 0 ... 10 10 0 0 11 0 1 0 ... 21 10 1 0 22 0 0 1 .. 1759 10 1 79 Order = increasing sectors, then increasing sides, then increasing cylinders. A DD disk has 11*2*80=1760 (0 to 1759) blocks, a HD disk has 22*2*80=3520 blocks. The length of .ADF files for a DD disk is therefore 512*11*2*80 = 901120 bytes. Those 'raw' blocks, 512 consecutive bytes, store different 'logical' blocks to manage files and directories. The classic Amiga filesystem has a internal command with one 32 bits wide offset parameter (unsigned). It tells where to start the read/write operation. The biggest size for an Amiga disk is therefore 2^32 = 4 GB. Anyway, there exists a 3rd party patch which changes the 32 bits limit to 64 bits (on Aminet, disk/misc/ffstd64.lha). ------------------------------------------------------------------------ 4. What is the logical organisation of an Amiga volume ? A volume is a floppy disk or a hard disk partition. The first file system for the Amiga was embedded in the version 1.2 of AmigaDOS. With version 2.xx of AmigaDOS the Fast File System (FFS) was introduced, an improved version of the 1.2, also called old file system (OFS). The version 3.0 of AmigaDOS added an international characters mode (INTL) and a directory cache mode (DIRC). Links are only supported under FFS. The start of a floppy volume contains space for sectors which may contain boot code. The middle of the volume contains information about the root (upper most) directory contents and information about free and used blocks. Other blocks are of course used to store files and directories. The file length, the directory tree depth, the number of entries per directory are only limited by disk size. (Actually the maximum filesize is limited to 4 Gbyte sizeof(ulong) which should normally be more than sufficient). Let's introduce the logical structures used by the Amiga file system in a table (for floppies) : Object Related logical blocks ------------+---------------------------------------------------------------- Volume Rootblock, Bitmap block File File Header block, Extension block, Data block, Link block Directory Rootblock, Directory block, Directory Cache block, Link block The main data types are a trees and linked lists. ----------------------- 4.1 What is a Bootblock ? Prior to Kickstart 2.0 the bootblock was hardcoded to consist of the first two sectors of the floppy disks (sector #0 and #1). As of Kick 2.0, booting via the boot-block could be done with any device driver and the number of blocks could be changed independantly of the number of reserved blocks by using BOOTBLOCKS in the DOS environment vector (DosEnvVec). * BootBlock ------------------------------------------------------------------------------- offset size number name meaning ------------------------------------------------------------------------------- 0/0x00 char 4 DiskType 'D''O''S' + flags flags = 3 least signifiant bits set clr 0 FFS OFS 1 INTL ONLY NO INTL ONLY 2 DIRC&INTL NO DIRC&INTL 4/0x04 ulong 1 Chksum special block checksum 8/0x08 ulong 1 Rootblock Value is 880 for DD and HD 12/0x0c char * Bootblock code (see 5.2 'Bootable disk' for more info) The size for a floppy disk is 1012, for a harddisk it is (DosEnvVec->Bootblocks * BSIZE) - 12 ------------------------------------------------------------------------------- The DiskType flag informs of the disk format. * OFS = Old/Original File System, the first one. (AmigaDOS 1.2) * FFS = Fast File System (AmigaDOS 2.04) * INTL = International characters Mode (see section 5.4). * DIRC = stands for Directory Cache Mode. This mode speeds up directory listing, but uses more disk space (see section 4.7). The Old filesystem may have the international and dircache mode enabled. If the international mode is enabled, the bit #1 is set. If the dircache is enabled, its flag is set (bit #2), and the international mode is also enabled, but the related flag (bit #1) will stay cleared. The correct values for flag are therefore : 0 (OFS), 1 (FFS), 2 (OFS/INTL), 3 (FFS/INTL), 4 (OFS/DIRC&INTL), 5 (FFS/DIRC&INTL). There are few differences between the two file systems : * OFS Datablock stores BSIZE-24 bytes (i.e. normally 488 bytes at most frequently used BSIZE of 512 bytes), FFS stores BSIZE bytes. * FFS supports directory caching, links and international mode, * the FFS is faster than OFS. If the Bootblock starts with the three characters 'PFS', another filesystem is used in place of AmigaDOS : the Professional File System. If the checksum and the DiskType are correct, the system will execute the bootblock code, at boot time, of course :-). The Bootblock code is optional, see 5.2 section. The Bootblock checksum algorithm follows : * in 68000 assembler : lea bootbuffer,a0 move.l a0,a1 clr.l 4(a1) ;clear the checksum move.w #(BOOTBLOCKSIZE/4)-1,d1 ;for floppy disks = 1024 ;for hd = (DosEnvVec->Bootblocks * BSIZE) moveq #0,d0 lpchk: add.l (a0)+,d0 ;accumulation bcc.s jump ;if carry set, add 1 to checksum add.l #1,d0 jump: dbf d1,lpchk ;next long word not.l d0 move.l d0,4(a1) ;new checksum * in C : #include<limits.h> #define Short(p) ((p)[0]<<8 | (p)[1]) #define Long(p) (Short(p)<<16 | Short(p+2)) unsigned long newsum,d; unsigned char buf[BOOTBLOCKSIZE]; /* contains bootblock */ /* for floppy disks = 1024, * for hd = (DosEnvVec->Bootblocks * BSIZE) */ int i; memset(buf+4,0,4); /* clear old checksum */ newsum=0L; for(i=0; i<BOOTBLOCKSIZE/4; i++) { d=Long(buf+i*4); if ( (ULONG_MAX-newsum) < d ) /* overflow */ newsum++; newsum+=d; } newsum=~newsum; /* not */ ----------------------- 4.2 What is a Rootblock ? The Rootblock is located at the physical middle of the media : block number 880 for DD disks, block 1760 for HDs. The exact calculation where it is stored is as follows: numCyls = highCyl - lowCyl + 1 highKey = numCyls * numSurfaces * numBlocksPerTrack - 1 rootKey = INT (numReserved + highKey) / 2 The Rootblock contains information about the disk : its name, its formatting date, etc ... It also contains information to access the files/directories/links located at the uppermost (root) directory. * Root block (BSIZE bytes) sector 880 for a DD disk, 1760 for a HD disk ------------------------------------------------------------------------------------------------ 0/ 0x00 ulong 1 type block primary type = T_HEADER (value 2) 4/ 0x04 ulong 1 header_key unused in rootblock (value 0) ulong 1 high_seq unused (value 0) 12/ 0x0c ulong 1 ht_size Hash table size in long (= BSIZE/4 - 56) For floppy disk value 0x48 16/ 0x10 ulong 1 first_data unused (value 0) 20/ 0x14 ulong 1 chksum Rootblock checksum 24/ 0x18 ulong * ht[] hash table (entry block number) * = (BSIZE/4) - 56 for floppy disk: size= 72 longwords BSIZE-200/-0xc8 ulong 1 bm_flag bitmap flag, -1 means VALID BSIZE-196/-0xc4 ulong 25 bm_pages[] bitmap blocks pointers (first at 0) BSIZE- 96/-0x60 ulong 1 bm_ext first bitmap extension block (Hard disks only) BSIZE- 92/-0x5c ulong 1 r_days last root alteration date : days since 1 jan 78 BSIZE- 88/-0x58 ulong 1 r_mins minutes past midnight BSIZE- 84/-0x54 ulong 1 r_ticks ticks (1/50 sec) past last minute BSIZE- 80/-0x50 char 1 name_len volume name length BSIZE- 79/-0x4f char 30 diskname[] volume name BSIZE- 49/-0x31 char 1 UNUSED set to 0 BSIZE- 48/-0x30 ulong 2 UNUSED set to 0 BSIZE- 40/-0x28 ulong 1 v_days last disk alteration date : days since 1 jan 78 BSIZE- 36/-0x24 ulong 1 v_mins minutes past midnight BSIZE- 32/-0x20 ulong 1 v_ticks ticks (1/50 sec) past last minute BSIZE- 28/-0x1c ulong 1 c_days filesystem creation date BSIZE- 24/-0x18 ulong 1 c_mins BSIZE- 20/-0x14 ulong 1 c_ticks ulong 1 next_hash unused (value = 0) ulong 1 parent_dir unused (value = 0) BSIZE- 8/-0x08 ulong 1 extension FFS: first directory cache block, 0 otherwise BSIZE- 4/-0x04 ulong 1 sec_type block secondary type = ST_ROOT (value 1) ------------------------------------------------------------------------------------------------ The '/' and ':' characters are forbidden in the volume name, but *!@#$%|^+&_()=\-[]{}';",<>.? and international like âè are allowed. The date fields in the root block (and other blocks) are structured in the form of DAYS, MINS and TICKS. The DAYS field contains the number of days since January 1. 1978. MINS is the number of minutes that have passed since midnight and TICKS are expressed in 1/50s of a second. A day value of zero is considered illegal by most programs. The r_date / r_min / r_ticks fields are updated to the last recent change of the root directory of this volume. The v_date / v_min / v_ticks fields are updated whenever any change was made to this volume, not just the root directory. The c_date / c_min / c_ticks fields contain the date and time when this volume was initialized (i.e. formatted) and is not changed during its lifetime. Some date constraints : 0 <= Mins < 60*24, 0 <= Ticks < 50*60 There should be no 2000 year real problem with the Amiga filesystem. Anyway, there is a page on 2YK problem with the Amiga at : http://www.amiga.com. 4.2.1 How to find the first sector of a directory entry ? Given the name of a file/directory/link you first have to compute its hash value with this algorithm : * The hash function : #include<ctype.h> int HashName(char *name) { int hash; /* sizeof(int)>=2 */ int i,l; l=hash=strlen(name); for(i=0; i<l; i++) { hash=hash*13; hash=hash + toupper(name[i]); /* not case sensitive */ hash=hash & 0x7ff; } hash=hash % ((BSIZE/4)-56); /* 0 < hash < 71 * in the case of 512 byte blocks */ return(hash); } // this code only works with non international mode disks // see section 5.4 The hash value is then used to access HashTable ('ht' field in Rootblock/Directory block). HashTable[ HashValue ] contains the number of the first block of your object (File header block, Directory block or Link block). But different names can result in the same HashValue. If more then one name has the same HashValue, the other blocks (for files and directory only) are stored in a chained list. This linked list starts at the 'next_hash' field of the File header or Directory block. For example : 'file_1a', 'file_24' and 'file_5u' have the same hash value. Here follows the method to find the requested block : HashValue = HashName( name ); name=uppercase(name); nsector = Hashtable[ HashValue ]; if (nsector != 0) { sector=Load(nsector); /* reads the 'nsector' sector */ sector.name = uppercase(sector.name); /* * follows the 'same HashValue' chained list if needed */ while ( sector.name != name and sector.Next_hash != 0) { sector = Load(nsector); sector.name = uppercase(sector.name); } if (sector.name != name) puts("File/Dir not found"); } else puts("File/Dir not found"); // this code only works with non international mode disks // see section 5.4 [Figure : HashTable and Directory content] Filenames characters can be lowercase and uppercase, but as shown in the Hash function, are not case sensitive. If, for a new entry, the value at hashTable[hashvalue] is different than 0, the new sector pointer will be stored in the last entry of the same-hashvalue-linked-list. It is necessary to check if the entry name already exists in this directory. In one word, in the same-hashValue list, the addition is made at the tail, not the head. 4.2.2 How to list all the directory entries ? Look through the whole HashTable and follow the same 'HashValue' linked lists if they exist. 4.2.3 How to compute the checksum ? #define Short(p) ((p)[0]<<8 | (p)[1]) #define Long(p) (Short(p)<<16 | Short(p+2)) unsigned long newsum; unsigned char buf[BSIZE]; /* contains rootblock */ int i; memset(buf+20,0,4); /* clear old checksum */ newsum=0L; for(i=0; i<(BSIZE/4); i++) newsum+=Long(buf+i*4); newsum=-newsum; /* negation */ This checksum algorithm works for most blocks type except for Bootblock. The bitmap table ('bm_pages[]') stores one or several pointers to Bitmap blocks. The first pointer is at index 0. ----------------------- 4.3 How are the free and used block lists managed? Bitmap blocks contain information about free and allocated sectors. One bit is used per sector. If the bit is set, the sector is free, a cleared bit means an allocated sector. Boot blocks allocation (2 for floppy, for hard disks the value can be found at DOSEnvVec->Bootblocks) is not stored in bitmap. Bitmap is stored in longs, the first sector of a long is the bit 0. * Bitmap block (BSIZE bytes), often at rootblock+1 ------------------------------------------------------------------------------- 0/0x00 long 1 checksum normal algorithm 4/0x04 long (BSIZE/4)-1 map ------------------------------------------------------------------------------- Here follows for a DD disk the relationship between bitmap and sector number : block # long # bit # ------------------------------- 2 0 0 3 0 1 4 0 2 ... 33 0 31 34 1 0 35 1 1 ... 880 27 14 881 27 15 ... 1759 54 28 1760 54 29 This map is 1758 bits long (1760-2) and is stored on 54 full filled long and the first 30th bits of the 55th long. * What is the 'bm_ext' field in Rootblock ? If 25 bitmap blocks (which pointers are stored on Rootblock) are not enough (for Hard Disks > ca. 50 Mbyte), extra needed bitmap blocks pointers are stored in bitmap extension blocks. * Bitmap extension block (BSIZE bytes) (Hard disk only) ------------------------------------------------------------------------------- 0/0x00 ulong (BSIZE/4)-1 bitmap block pointers BSIZE- 4/0x04 ulong 1 next (0 for last) ------------------------------------------------------------------------------- The Bitmap extension linked list start at Rootblock with the 'bm_ext'. ----------------------- 4.4 How are files stored ? The first block of a file is the File header block, which contains information about the file (size, last access date, ...) and pointers to the first ((BSIZE/4)-56) Data blocks (i.e. for the often found case of BSIZE=512 it contains 72 pointers). Data blocks store the actual file data. If more than ((BSIZE/4)-56) Data blocks are needed to store a file, the other Data block pointers are stored in File extension blocks. File extension blocks are organised in a linked list, which starts in File header block ('extension' field). [Figure : Chained lists of the blocks which store files] * File header block (BSIZE bytes) ------------------------------------------------------------------------------------------------ 0/ 0x00 ulong 1 type block primary type T_HEADER (==2) 4/ 0x04 ulong 1 header_key self pointer (to this block) 8/ 0x08 ulong 1 high_seq number of data block ptr stored here 12/ 0x0c ulong 1 data_size unused (==0) 16/ 0x10 ulong 1 first_data first data block ptr 20/ 0x14 ulong 1 chksum same algorithm as rootblock 24/ 0x18 ulong * data_blocks[] data blk ptr (first at BSIZE-204 ) * = (BSIZE/4) - 56 BSIZE-200/-0xc8 ulong 2 UNUSED set to 0 BSIZE-192/-0xc0 ulong 1 protect protection flags (bit set) (default set to 0) 0 delete forbidden (D) 1 modification forbidden (E) 2 write/update forbidden (W) 3 read forbidden (R) 4 file is archived (A) 5 pure, can be made resident (P) 6 file is a script (S) 7 hidden file with DIR (H) 23-8 reserved 31-24 user BSIZE-188/-0xbc ulong 1 byte_size file size in bytes BSIZE-184/-0xb8 char 1 comm_len file comment length BSIZE-183/-0xb7 char 79 comment[] comment (max. 79 chars permitted) BSIZE-104/-0x69 char 12 UNUSED set to 0 BSIZE- 92/-0x5c ulong 1 days last access date (days since 1 jan 78) BSIZE- 88/-0x58 ulong 1 mins last access time BSIZE- 84/-0x54 ulong 1 ticks in 1/50s of a seconds BSIZE- 80/-0x50 char 1 name_len filename length BSIZE- 79/-0x4f char 30 filename[] filename (max. 30 chars permitted) BSIZE- 49/-0x31 char 1 UNUSED set to 0 BSIZE- 48/-0x30 ulong 1 UNUSED set to 0 BSIZE- 44/-0x2a ulong 1 real_entry FFS : unused (== 0) BSIZE- 40/-0x28 ulong 1 next_link FFS : hardlinks chained list (first=newest) BSIZE- 36/-0x24 ulong 5 UNUSED set to 0 BSIZE- 16/-0x10 ulong 1 hash_chain next entry ptr with same hash BSIZE- 12/-0x0c ulong 1 parent parent directory BSIZE- 8/-0x08 ulong 1 extension pointer to 1st file extension block BSIZE- 4/-0x04 ulong 1 sec_type secondary type : ST_FILE (== -3) ------------------------------------------------------------------------------------------------ As within volume names ':' and '/' are forbidden within file names. The number of blocks used to store one file depends on the filesystem used, OFS or FFS. If one file has 7 datablocks, the first is at datablock[71-0], the last at datablocks[71-6], and highseq is equals to 7. For the OFS there are two ways of reading the contents of a file. First by traversing the linked list of data blocks that is pointed to in first_data (offset 16) and then following the pointers in each file data block. The other way of accessing the file data is by using the data_blocks[] table and going backwards through the data blocks listed there and then the File extension blocks. As the FFS doesn't contain extra information in the data blocks (no pointer list, no checksum) the only way of accessing the file contents is by going through the data_blocks[] table and the File extension blocks. For an empty file, a Header file block is written, with 'byte_size' equal to 0, and no Data block pointers in 'data_blocks[]'. * File extension block (BSIZE bytes) (first pointer in File header) ------------------------------------------------------------------------------------------------ 0/ 0x00 ulong 1 type primary type : T_LIST (== 16) 4/ 0x04 ulong 1 header_key self pointer 8/ 0x08 ulong 1 high_seq number of data blk ptr stored 12/ 0x0c ulong 1 UNUSED unused (== 0) 16/ 0x10 ulong 1 UNUSED unused (== 0) 20/ 0x14 ulong 1 chksum rootblock algorithm 24/ 0x18 ulong * data_blocks[] data blk ptr (first at BSIZE-204) * = (BSIZE/4) - 56 BSIZE-200/-0xc8 ulong 46 info unused (== 0) BSIZE- 16/-0x10 ulong 1 UNUSED unused (== 0) BSIZE- 12/-0x0c ulong 1 parent ptr to parent directory BSIZE- 8/-0x08 ulong 1 extension next file header extension block, 0 for the last BSIZE- 4/-0x04 ulong 1 sec_type secondary type : ST_FILE (== -3) ------------------------------------------------------------------------------------------------ * Data blocks (BSIZE bytes) (first pointer in File header 'first_data' and 'data_blocks[((BSIZE/4)-57)]') Old File System data block (BSIZE bytes) ------------------------------------------------------------------------------- 0/0 ulong 1 type primary type : T_DATA (== 8) 4/4 ulong 1 header_key pointer to file header block 8/8 ulong 1 seq_num file data block number (first is #1) 12/c ulong 1 data_size data size <= (BSIZE-24) 16/10 ulong 1 next_data next data block ptr (0 for last) 20/14 ulong 1 chksum rootblock algorithm 24/18 UCHAR * data[] file data size <= (BSIZE-24) ------------------------------------------------------------------------------- In OFS, there is a second way to read a file : using the Data block chained list. The list starts in File header ('first_data') and goes on with 'next_data' in each Data block. Fast File System (BSIZE bytes) ------------------------------------------------------------------------------- 0/0 UCHAR BSIZE data[] file data ------------------------------------------------------------------------------- In FFS, the only way to read or recover a file is to use data_blocks[] in the file header block and the File extension blocks. If a File header or File extension block is unreadable, there is no way to find the corresponding Data blocks. The OFS is more robust than FFS, but slower and can store less data on disk. As you see, disk salvaging is easier with OFS. When a file is deleted, only its File header block number is cleared from the Directory block (or from the same-hash-value list) and the bitmap is updated. File header block, Data blocks and File extension blocks are not cleared ! but the bitmap blocks are updated. Nevertheless, the undelete operation is easy . ----------------------- 4.5 How are directories stored? Directory blocks are very similar to Rootblock, except they don't need information about bitmap and disk, but have comments. * User directory block (BSIZE bytes) ------------------------------------------------------------------------------------------------ 0/ 0x00 ulong 1 type block primary type = T_HEADER (value 2) 4/ 0x04 ulong 1 header_key self pointer 8/ 0x08 ulong 3 UNUSED unused (== 0) 20/ 0x14 ulong 1 chksum normal checksum algorithm 24/ 0x18 ulong * ht[] hash table (entry block number) * = (BSIZE/4) - 56 for floppy disk: size= 72 longwords BSIZE-200/-0xc8 ulong 2 UNUSED unused (== 0) BSIZE-192/-0xc0 ulong 1 protect protection flags (bit set) (default set to 0) 0 delete forbidden (D) 1 modification forbidden (E) 2 write/update forbidden (W) 3 read forbidden (R) 4 directory is archived (A) 5 pure, can be made resident (P) 6 file is a script (S) 7 hidden file with DIR (H) 23-8 reserved 31-24 user BSIZE-188/-0xbc ulong 1 UNUSED unused (== 0) BSIZE-184/-0xb8 char 1 comm_len directory comment length BSIZE-183/-0xb7 char 79 comment[] comment (max. 79 chars permitted) BSIZE-104/-0x69 char 12 UNUSED set to 0 BSIZE- 92/-0x5c ulong 1 days last access date (days since 1 jan 78) BSIZE- 88/-0x58 ulong 1 mins last access time BSIZE- 84/-0x54 ulong 1 ticks in 1/50s of a seconds BSIZE- 80/-0x50 char 1 name_len directory name length BSIZE- 79/-0x4f char 30 dirname[] directory (max. 30 chars permitted) BSIZE- 49/-0x31 char 1 UNUSED set to 0 BSIZE- 48/-0x30 ulong 2 UNUSED set to 0 BSIZE- 40/-0x28 ulong 1 next_link FFS : hardlinks chained list (first=newest) BSIZE- 36/-0x24 ulong 5 UNUSED set to 0 BSIZE- 16/-0x10 ulong 1 hash_chain next entry ptr with same hash BSIZE- 12/-0x0c ulong 1 parent parent directory BSIZE- 8/-0x08 ulong 1 extension FFS : first directory cache block BSIZE- 4/-0x04 ulong 1 sec_type secondary type : ST_USERDIR (== 2) ------------------------------------------------------------------------------------------------ You can obtain directory listing exactly like with the root directory. ----------------------- 4.6 How are links implemented in AmigaDOS ? Only FFS handles links and directory caching. Soft links are not supported by AmigaDOS 3.0. Linked files are seen as directories... However, some shells (like Csh 5.37) support them, so I'm supplying the structure. 4.6.1 Hard links * Hard link (BSIZE bytes) ------------------------------------------------------------------------------------------------ 0/ 0x00 ulong 1 type block primary type = T_HEADER (value 2) 4/ 0x04 ulong 1 header_key self pointer 8/ 0x08 ulong 3 UNUSED unused (== 0) 20/ 0x14 ulong 1 chksum normal checksum algorithm 24/ 0x18 ulong * UNUSED set to 0 * = (BSIZE/4) - 54 for floppy disk: size= 74 longwords BSIZE-192/-0xc0 ulong 1 protect protection flags (bit set) (default set to 0) 0 delete forbidden (D) 1 modification forbidden (E) 2 write/update forbidden (W) 3 read forbidden (R) 4 directory is archived (A) 5 pure, can be made resident (P) 6 file is a script (S) 7 hidden file with DIR (H) 23-8 reserved 31-24 user BSIZE-188/-0xbc ulong 1 UNUSED unused (== 0) BSIZE-184/-0xb8 char 1 comm_len comment length BSIZE-183/-0xb7 char 79 comment[] comment (max. 79 chars permitted) BSIZE-104/-0x69 char 12 UNUSED set to 0 BSIZE- 92/-0x5c ulong 1 days last access date (days since 1 jan 78) BSIZE- 88/-0x58 ulong 1 mins last access time BSIZE- 84/-0x54 ulong 1 ticks in 1/50s of a seconds BSIZE- 80/-0x50 char 1 name_len hard link name length BSIZE- 79/-0x4f char 30 hlname[] hardlink name (max. 30 chars permitted) BSIZE- 49/-0x31 char 1 UNUSED set to 0 BSIZE- 48/-0x30 ulong 1 UNUSED set to 0 BSIZE- 44/-0x2c ulong 1 real_entry FFS : pointer to "real" file or directory BSIZE- 40/-0x28 ulong 1 next_link FFS : hardlinks chained list (first=newest) BSIZE- 36/-0x24 ulong 5 UNUSED set to 0 BSIZE- 16/-0x10 ulong 1 hash_chain next entry ptr with same hash BSIZE- 12/-0x0c ulong 1 parent parent directory BSIZE- 8/-0x08 ulong 1 UNUSED set to 0 BSIZE- 4/-0x04 ulong 1 sec_type secondary type : ST_LINKFILE = -4 ST_LINKDIR = 4 ------------------------------------------------------------------------------------------------ A 'real' entry is a file or directory entry, opposed to link entries. A hard link can only be created on the same disk as the real entry disk. Several links can be made on the same real entry. This is stored with a chained list. 'real entry' always contains the real entry block pointer. 'next_link' stores the links linked list. New entries are added at the head: >ls ------rw-d 1912 15-May-96 22:28:08 real Chained list state : block# real next name ---------------------------- 484 0 0 real >ln real link1 >ls ------rw-d 1912 15-May-96 22:28:08 real -H----rw-d 1912 15-May-96 22:28:10 link1 -> Empty:real block# real next name ---------------------------- 484 0 104 real 104 484 0 link1 >ln link1 link2 >ls ------rw-d 1912 15-May-96 22:28:08 real -H----rw-d 1912 15-May-96 22:28:10 link1 -> Empty:real -H----rw-d 1912 15-May-96 22:28:12 link2 -> Empty:real block# real next name ---------------------------- 484 0 107 real 104 484 0 link1 107 484 104 link2 The links are stored 'newest first', due to the adding at head. real -> newest link -> ... -> oldest link -> 0 -> means "points to" 4.6.2 Soft links * Soft link (BSIZE bytes) ------------------------------------------------------------------------------------------------ 0/ 0x00 ulong 1 type block primary type = T_HEADER (value 2) 4/ 0x04 ulong 1 header_key self pointer 8/ 0x08 ulong 3 UNUSED unused (== 0) 20/ 0x14 ulong 1 chksum normal checksum algorithm 24/ 0x18 ulong * symbolic_name path name to referenced object, Cstring * = ((BSIZE - 224) - 1) for floppy disk: size= 288 - 1 chars BSIZE-200/-0xc8 ulong 2 UNUSED unused (== 0) BSIZE-192/-0xc0 ulong 1 protect protection flags (bit set) (default set to 0) 0 delete forbidden (D) 1 modification forbidden (E) 2 write/update forbidden (W) 3 read forbidden (R) 4 directory is archived (A) 5 pure, can be made resident (P) 6 file is a script (S) 7 hidden file with DIR (H) 23-8 reserved 31-24 user BSIZE-188/-0xbc ulong 1 UNUSED unused (== 0) BSIZE-184/-0xb8 char 1 comm_len comment length BSIZE-183/-0xb7 char 79 comment[] comment (max. 79 chars permitted) BSIZE-104/-0x69 char 12 UNUSED set to 0 BSIZE- 92/-0x5c ulong 1 days last access date (days since 1 jan 78) BSIZE- 88/-0x58 ulong 1 mins last access time BSIZE- 84/-0x54 ulong 1 ticks in 1/50s of a seconds BSIZE- 80/-0x50 char 1 name_len soft link name length BSIZE- 79/-0x4f char 30 slname[] softlink name (max. 30 chars permitted) BSIZE- 49/-0x31 char 1 UNUSED set to 0 BSIZE- 48/-0x30 ulong 8 UNUSED set to 0 BSIZE- 16/-0x10 ulong 1 hash_chain next entry ptr with same hash BSIZE- 12/-0x0c ulong 1 parent parent directory BSIZE- 8/-0x08 ulong 1 UNUSED set to 0 BSIZE- 4/-0x04 ulong 1 sec_type secondary type : ST_SOFTLINK = 3 ------------------------------------------------------------------------------------------------ ----------------------- 4.7 How are the blocks associated with the directory cache mode ? To speed up directory listing, Directory cache blocks have been created. Directory cache blocks are also organised in chained lists. The list starts at the directory block (root or normal directory) with the 'extension' field. * Directory cache block (BSIZE bytes) ------------------------------------------------------------------------------- 0/0 ulong 1 type DIRCACHE == 33 (0x21) 4/4 ulong 1 header_key self pointer 8/8 ulong 1 parent parent directory 12/c ulong 1 records_nb directory entry records in this block 16/10 ulong 1 next_dirc dir cache chained list 20/14 ulong 1 chksum normal checksum 24/18 UCHAR * records[] entries list (size = BSIZE-24) ------------------------------------------------------------------------------- The directory entries are stored this way : * Directory cache block entry record (26 <= size (in bytes) <= 77) ------------------------------------------------------------------------------- 0 ulong 1 header entry block pointer (the link block for a link) 4 ulong 1 size file size (0 for a directory or a link) 8 ulong 1 protect protection flags (0 for a link ?) 12 ulong 1 UNUSED ( == 0 ) 16 short 1 days date (always filled) 18 short 1 mins time (always filled) 20 short 1 ticks 22 char 1 type secondary type 23 char 1 name_len 1 <= len <= 30 (nl) 24 char ? name name 24+nl char 1 comm_len 0 <= len <= 22 (cl) 25+nl char ? comment comment 25+nl+cl char 1 OPTIONAL padding byte(680x0 longs must be word aligned) ------------------------------------------------------------------------------- ------------------------------------------------------------------------ 5. How does a blank disk look like ? A minimal blank disk has a Bootblock, a Rootblock and a Bitmap block. 5.1 a Minimal blank floppy disk * The Bootblock (0 and 1) 0 char 4 ID 'D''O''S' + flags 4 long 1023 full of zeros * The Rootblock (880) 0 long 1 type 2 12/c long 1 ht_size 0x48 20/14 long 1 checksum computed 312/138 long 1 bm_flag -1 (valid bitmap) 316/13c long 1 bm_pages[0] bitmap sector # 420/1a4 long 1 last access date 424/1a8 long 1 last access time 428/1ac long 1 last access time 432/1b0 char 1 disk_name size 433/1b1 char ? disk_name 472/1d8 long 1 last access date 476/1dc long 1 last access time 480/1e0 long 1 last access time 484/1e4 long 1 creation date 488/1e8 long 1 creation time 492/1ec long 1 creation time 504/1f8 long 1 FFS : first dir cache sector or 0 508/1fc long 1 sub_type 1 No specified fields are set to 0. * The Bitmap block (here 881) for a DD disk 0 long 1 checksum 4 long 27 free sectors 0xffffffff 112/70 long 1 root+bitmap 0xffff3fff 116/74 long 27 free sectors 0xffffffff 120/78 long 72 unused !=0 ----------------------- 5.2 A 'Bootable' floppy disk * The Bootblock becomes : 0/0x00 long 1 ID 'D''O''S' + flags 4/0x04 long 1 checksum computed 8/0x08 long 1 rootblock ? 880 12/0x0c byte 81 bootcode AmigaDOS 3.0 version values disassembled --------------+--------------------- 43FA003E lea exp(pc),a1 ;Lib name 7025 moveq #37,d0 ;Lib version 4EAEFDD8 jsr -552(a6) ;OpenLibrary() 4A80 tst.l d0 ;error == 0 670C beq.b error1 2240 move.l d0,a1 ;lib pointer 08E90006 0022 bset #6,34(a1) ;(*) 4EAEFE62 jsr -414(a6) ;CloseLibrary() 43FA0018 error1: lea dos(PC),a1 ;name 4EAEFFA0 jsr -96(a6) ;FindResident() 4A80 tst.l d0 670A beq.b error2 ;not found 2040 move.l d0,a0 20680016 move.l 22(a0),a0 ;DosInit sub 7000 moveq #0,d0 4E75 rts 70FF error2: moveq #-1,d0 4E75 rts 646F732E 6C696272 617279 dos: "dos.library" 00 ;padding byte 65787061 6E73696F 6E2E6C69 62726172 79 exp: "expansion.library" 93/0x5d byte 931 full of zeros (*) from Thomas Kessler (tkessler@ra.abo.fi), may 1997 : This bit tells the shell (which opens its shell-window when booting the startup-sequence) not to open window unless needed, so a black screen stays there during boot instead of an empty shell-windows (it's a os2.x feature). ----------------------- 5.3 A Directory cache mode floppy disk * A directory cache block (here 882) 0 long 1 type 0x21 4 long 1 self pointer 882 8 long 1 cached dir 880 (root) 12/c long 1 entries number 0 16/10 long 1 next dir cache 0 (last) 20/14 long 1 checksum computed 24 long 122 full of zeros ----------------------- 5.4 International Mode The toupper() function in the HashName() function (3.2.1 paragraph) is replaced by the following function with the aim of better handling international characters : int intl_toupper(int c) { return (c>='a' && c<='z') || (c>=224 && c<=254 && c!=247) ? c - ('a'-'A') : c ; } In the Amiga ASCII table, the international character codes are between 192 and 254. Uppercase caracters are between 192 and 222, the lowercase versions of them are between 224 and 254. The only exception are the codes 215 and 247, which are respectively the multiply sign and the divide sign. The Amiga character set is the same as ISO 8879 Latin-1 character set, used in HTML standard. This character set is described here : http://www.w3c.org/ ------------------------------------------------------------------------ 6. The structure of a hard disk The following structures is mainly extracted from the 'devices/hardblocks.h' and 'dos/filehandler.h' files delivered in Commodore developer kits. The hard disk specific structures mainly store the drive geometry, the written partitions sizes and the filesystem bootcode. The five kind of blocks are in a reserved area, at the beginning of the surface. The first of them, Rigid Disk block (RDSK), must be found within the first 16 blocks of BSIZE lenght. But it can be written inside the data area, which is dangerous. 6.1 What is the Rigid Disk Block ? * Rigid Disk block (256 bytes) must exist within the first 16 blocks ------------------------------------------------------------------------------- 0/0 char 4 id 'RDSK' 4/4 ulong 1 size in longs == 64 8/8 long 1 checksum classic Rootblock algorithm 12/c ulong 1 hostID SCSI Target ID of host (== 7 for IDE and ZIP disks) 16/10 ulong 1 block size typically 512 bytes, but can be other powers of 2 20/14 ulong 1 flags typically 0x17 Bits If set means : 0 No disks exists to be configured after this one on this controller 1 No LUNs exists to be configured greater than this one at this SCSI Target ID 2 No target IDs exists to be configured greater than this one on this SCSI bus 3 Don't bother trying to perform reselection when talking to this drive 4 Disk indentification valid 5 Controller indentification valid 6 Drive supports SCSI synchronous mode (can be dangerous if it doesn't) 24/18 ulong 1 Bad blockList block pointer (-1 means last block) 28/1c ulong 1 PartitionList block pointer (-1 means last) 32/20 ulong 1 FileSysHdrList block pointer (-1 means last) 36/24 ulong 1 DriveInit code optional drive-specific init code DriveInit(lun,rdb,ior) : "C" stack and d0/a0/a1 40/28 ulong 6 RESERVED == -1 Physical drive caracteristics 64/40 ulong 1 cylinders number of drive cylinder 68/44 ulong 1 sectors sectors per track 72/48 ulong 1 heads number of drive heads 76/4c ulong 1 interleave 80/50 ulong 1 parking zone landing zone cylinders soon after the last cylinder 84/54 ulong 3 RESERVED == 0 96/60 ulong 1 WritePreComp starting cyl : write precompensation 100/64 ulong 1 ReducedWrite starting cyl : reduced write current 104/68 ulong 1 StepRate drive step rate 108/6c ulong 5 RESERVED == 0 Logical drive caracteristics 128/80 ulong 1 RDB_BlockLo low block of range reserved for hardblk 132/84 ulong 1 RDB_BlockHi high block of range for this hardblocks 136/88 ulong 1 LoCylinder low cylinder of partitionable disk area 140/8c ulong 1 HiCylinder high cylinder of partitionable data area 144/90 ulong 1 CylBlocks number of blocks available per cylinder 148/94 ulong 1 AutoParkSeconds zero for no autopark 152/98 ulong 1 HighRSDKBlock highest block used by RDSK (not including replacement bad blocks) 156/9c ulong 1 RESERVED == 0 Drive identification 160/a0 char 8 DiskVendor ie 'IOMEGA' 168/a8 char 16 DiskProduct ie 'ZIP 100' 184/b8 char 4 DiskRevision ie 'R.41' 188/bc char 8 ControllerVendor 196/c4 char 16 ControllerProduct 212/d4 char 4 ControllerRevision 216/d8 ulong 10 RESERVED == 0 256/100 ------------------------------------------------------------------------------- * How to find the physical geometry of the disk ? A hard disk is made of several physical disks. They have one head for each writable side. Each physical disk consists of several tracks, which consist of several sectors. One cylinder is the set of the tracks which have the same number on each disk. The total size of the hard disk is expressed in cylinders ('cylinders'). The size of a cylinder is : the number of heads per cylinder ('heads') x the number of sectors per track ('sectors') x the size of a block ('block size'). The 'CylBlocks' field equals to 'heads' x 'sectors'. The reserved area is often the 2 first cylinders, between the 'RDB_BlockLo' block and the 'RDB_BlockHi' block, included. The partitionable area, starts at the 'LoCylinder' cylinder until the 'HiCylinder' cylinder, included. The really last used sector in the reserved area is the sector numbered 'HighRSDKBlock', the first is numbered 0. The SCSI 'hostID' is set to the id of the SCSI host controller, which is typically 7. Real SCSI drives ID must be between 0 and 6. The RDSK block is the "root" of the reserved area. It also contains the first blocks of three linked lists : one the bad blocks replacement, one for the partition definitions and one last for the filesystem information. Some geometry examples : * a Zip disk : 2891 cylinders, 1 head, 68 sectors, * my 80Mb Seagate IDE harddisk : 980 cylinders, 10 heads, 17 sectors. * a 500 Mbyte Fujitsu 2624SA: 1472 cylinders, 11 heads, 63 sectors * a 50 Mbyte Quantum LPS52: 2085 cylinders, 1 head, 49 sectors ----------------------- 6.2 How are bad blocks managed ? * Bad Block block (BSIZE bytes) first in RDSK 'BadBlockList' field ------------------------------------------------------------------------------- 0/0 ulong 1 id 'BADB' 4/4 ulong 1 size in longs == 128 for BSIZE = 512 8/8 long 1 checksum 12/c ulong 1 HostID == 7 ? 16/10 ulong 1 next next BadBlock block 20/14 ulong 1 RESERVED 24/18 * BlockPairs[] bad block entries table * size = ((BSIZE/4)-6)/2 (for BSIZE=512 = 61*8 byte entries) ------------------------------------------------------------------------------- * Bad Block entry (8 bytes) stored in BadBlock 'BlockPairs[]' field ------------------------------------------------------------------------------- 0/0 ulong 1 BadBlock block number of bad block 4/4 ulong 1 GoodBlock block number of replacement block ------------------------------------------------------------------------------- ----------------------- 6.3 How are partitions stored? * Partition block (256 bytes) first in RDSK 'PartitionList' field ------------------------------------------------------------------------------- 0/0 char 4 ID 'PART' 4/4 ulong 1 size in long of checksummed structure (== 64) 8/8 ulong 1 checksum classic algorithm 12/c ulong 1 hostID SCSI Target ID of host (== 7) 16/10 ulong 1 next block number of the next Partitionblock 20/14 ulong 1 Flags Bits If set means 0 This partition is bootable 1 No automount 24/18 ulong 2 RESERVED 32/20 ulong 1 DevFlags preferred flags for OpenDevice 36/24 char 1 DriveName len length of Drive name (e.g. 3) 37/25 char 31 DriveName e.g. 'DH0' 68/44 ulong 15 RESERVED DOS Environment vector (DOSEnvVec) (often defined in MountLists) 128/80 ulong 1 size of vector == 16 (longs), 11 is the minimal value 132/84 ulong 1 SizeBlock size of the blocks in longs == 128 for BSIZE = 512 136/88 ulong 1 SecOrg == 0 140/8c ulong 1 Surfaces number of heads (surfaces) of drive 144/90 ulong 1 sectors/block sectors per block == 1 148/94 ulong 1 blocks/track blocks per track 152/98 ulong 1 Reserved DOS reserved blocks at start of partition usually = 2 (minimum 1) 156/9c ulong 1 PreAlloc DOS reserved blocks at end of partition (no impact on Root block allocation) normally set to == 0 160/a0 ulong 1 Interleave == 0 164/a4 ulong 1 LowCyl first cylinder of a partition (inclusive) 168/a8 ulong 1 HighCyl last cylinder of a partition (inclusive) 172/ac ulong 1 NumBuffer often 30 (used for buffering) 176/b0 ulong 1 BufMemType type of mem to allocate for buffers ==0 180/b4 ulong 1 MaxTransfer max number of type to transfer at a type often 0x7fff ffff 184/b8 ulong 1 Mask Address mask to block out certain memory often 0xffff fffe 188/bc ulong 1 BootPri boot priority for autoboot 192/c0 char 4 DosType 'DOS' and the FFS/OFS flag only also 'UNI'\0 = AT&T SysV filesystem 'UNI'\1 = UNIX boot filesystem 'UNI'\2 = BSD filesystem for SysV 'resv' = reserved (swap space) 196/c4 ulong 1 Baud Define default baud rate for Commodore's SER and AUX handlers, originally used with the A2232 multiserial board 200/c8 ulong 1 Control used by Commodore's AUX handler 204/cc ulong 1 Bootblocks Kickstart 2.0: number of blocks containing boot code to be loaded at startup 208/d0 ulong 12 RESERVED ------------------------------------------------------------------------------- There exists one 'PART' block per partition. The block pointers in the reserved area are relative to the beginning of the media. The block pointers in a partition are relative to the first block of the partition. The Rootblock of a partition is normally located in the middle of an AmigaDOS filesystem. Please see 4.2 What is a Rootblock? for the exact calculation of it's location. The first two blocks of a partition contain a Bootblock. You have to use it to determine the correct file system, and if the international or dircache modes are used. Don't rely only on the PART and FSHD 'DosType' field. ----------------------- 6.4 What are FSHD blocks ? * Filesystem header block (256 bytes) first in RSDK 'FileSysHeaderList' ------------------------------------------------------------------------------- 0/0 char 4 id 'FSHD' 4/4 ulong 1 size in longs == 64 8/8 long 1 checksum classic algorithm 12/c ulong 1 hostID SCSI Target ID of host (often 7) 16/10 ulong 1 next block number of next FileSysHeaderBlock 20/14 ulong 1 flags 24/18 ulong 2 RESERVED 32/20 char 4 DosType 'DOS' and OFS/FFS DIRCACHE INTL bits 36/24 ulong 1 Version filesystem version 0x0027001b == 39.27 40/28 ulong 1 PatchFlags bits set for those of the following that need to be substituted into a standard device node for this filesystem : e.g. 0x180 to substitute SegList and GlobalVec Device node 44/2c ulong 1 Type device node type == 0 48/30 ulong 1 Task standard DOS "task" field == 0 52/34 ulong 1 Lock not used == 0 56/38 ulong 1 Handler filename to loadseg == 0 60/3c ulong 1 StackSize stacksize to use when starting task ==0 64/40 ulong 1 Priority task priority when starting task == 0 68/44 ulong 1 Startup startup msg == 0 72/48 ulong 1 SegListBlock first of linked list of LoadSegBlocks : note that this entry requires some processing before substitution 76/4c ulong 1 GlobalVec BCPL global vector when starting task =-1 80/50 ulong 23 RESERVED by PatchFlags 172/ac ulong 21 RESERVED ------------------------------------------------------------------------------- This block contains information on how to lauch the task which will manage the filesystem. You don't need it to reach partitions. ----------------------- 6.5 What are LSEG blocks ? * LoadSeg block (BSIZE bytes) first in FileSysHeaderBlock 'SegListBlocks' field ------------------------------------------------------------------------------- 0/0 char 4 id 'LSEG' 4/4 long * size in longs size of this checksummed structure * size = BSIZE/4 8/8 long 1 checksum classic checksum 12/c long 1 hostID SCSI Target ID of host (often 7) 16/10 long 1 next block number of the next LoadSegBlock (-1 for the last) 20/14 uchar * LoadData[] code stored like an executable, with relocation hunks * size = ((BSIZE/4) - 5) ------------------------------------------------------------------------------- This block contains the code of the filesystem. It isn't needed to reach partitions. ------------------------------------------------------------------------ 7. The Hard file : a big floppy dump file A hardfile is a file which contains an Amiga volume. It is created with WinUAE (http://www.codepoet.com/UAE/), and not the Amiga and the AmigaDOS. WinUAE is able to produce an empty file with random contents of a choosen size, often several megabytes long. Under WinUAE, a AmigaDOS device appears, associated with the uaehf.device (UAE hardfile). You have to format it with the Workbench, and you obtain an 'hardfile'. This volume is then usable inside the emulator by AmigaDOS (it should also be mountable under Linux with the AFFS filesystem). An hardfile is like a floppy disk dump, but bigger : it has a bootblock, a rootblock, a bitmap and perhaps dircache blocks. The first three bytes of a hardfile is then 'D' 'O' 'S'. ------------------------------------------------------------------------ 8. Advanced information Bitmap related * Bitmap allocation starts at root block, upto highest block. The next allocated blocks are located just after boot blocks and finally the last allocated block is the sector before root block. root -> max -> boot+1 -> root-1 -> means "followed on disk by" If you free some blocks by deleting a file, for example, the first next used block will be the first free block encountered starting from the Rootblock. The just freed blocks will be reused. It means that when you delete a file and you want to recover it, don't write anything else on the disk. This strategy must have been chosen to minimize fragmentation Files related * The order in which data and file extension blocks for a given file are written on disk differs with OFS and FFS. * OFS & FFS : All the data blocks of the file header block are written first. * FFS : Then follow all the file extension blocks of the file, then all the remaining data blocks are written. OFS : Each file extension block is followed by the related data blocks. So the last extension block is followed by the remaining data blocks. OFS: header -> data blocks -> ext. block -> data blocks -> ext. block -> data blocks FFS: header -> data blocks -> all ext. block -> all remaining data blocks -> means "followed on disk by" This difference is probably the main reason why FFS is faster then OFS. Compare the ADF logical blocks root dir fileh hlink slink fext data dirc ---------------------------------------------------------------------------------------- 0/ 0x00 1st_type 2 2 2 2 2 16 8 33 4/ 0x04 header_key / x x x x x x x 8/ 0x08 / / nb_blo / / nb_blo block# PARENT 12/ 0x0c table_size 72 / / / / / nb_data nb_rec 16/ 0x10 list / / data#1 / / / next next 20/ 0x14 chksum x x x x x x x x 24/ 0x18 table ht ht blocks / / blocks data records ... BSIZE-184/-0xb8 comment_len / x x / / / / / BSIZE-183/-0xb7 comment / x x / / / / / ... BSIZE- 92/-0x5c days x x x x x / / / BSIZE- 88/-0x58 mins x x x x x / / / BSIZE- 84/-0x54 ticks x x x x x / / / BSIZE- 80/-0x50 name_len x x x x x / / / BSIZE- 79/-0x4f name x x x x x / / / ... BSIZE- 16/-0x10 hash_chain / x x / / / BSIZE- 12/-0x0c parent / x x x x fhdr / / BSIZE- 8/-0x08 extension cache cache fext / / next / / BSIZE- 4/-0x04 2nd_type 1 2 -3 -4/4 3 -3 / / ---------------------------------------------------------------------------------------- type of blocks : root=rootblock, dir=directory, fileh=file header, fext=file extension, hlink=hard link, slink=soft link, dirc=directory cache, data=OFS data. special values : /=unused x=used next=next block of same type How to rename an entry ? 1. Compute the new hashvalue 2. Move the first sector pointer from the old hashvalue index to the new one 3. Change the name in the directory or file header block ------------------------------------------------------------------------ 9. References and links * ASM Sources: * Scoopex and Crionics disassembled demo hardloaders * 'the floppy disk book' copier source file, DATA BECKER books, 1988 * On-Line material : * Very good 'ded.doc' file including Hard Disk information : ftp://ftp.funet.fi/pub/amiga/utilities/disk/Ded-1.11.lha * A clean track-loader which doesn't use AmigaDOS (by Patrik Lundquist) : ftp://ftp.wustl.edu/pub/aminet/dev/asm/t-loader.lha * A replacement for 'trackdisk.device' : ftp://ftp.wustl.edu/pub/aminet/disk/misc/hackdisk202.lha * 'amigadisk_hardware.doc' (by Dave Edwards, Mark Meany, ... of ACC) : http://home.sol.no/svjohan/assem/refs/diskHW.lha * Books : * The Amiga Guru Book, Ralph Babel, 1993 * Rom Kernel Reference Manual : Hardware, pages 235-244, Addison Wesley * La Bible de l'Amiga, Dittrich/Gelfand/Schemmel, Data Becker, 1988. The AmigaDOS reference manual probably contains a lot of information about Amiga file systems, but i don't own it (Addison Wesley). The most detailed information about AmigaDOS can be found in Ralph Babel's "Amiga Guru Book". ------------------------------------------------------------------------ 10. C routines : the ADF library The ADFlib is a portable C library designed to manage Amiga formatted devices like harddisks and ZIP disks, or dump files of this kind of media via the .ADF format. The API permits you to : * mount/unmount a device (real one or a dump file), * mount/unmount a volume (partition), * create/open/close/delete/move a file, * read/write bytes from/to a file, * create/delete a directory, * get directory contents, change current directory, get parent directory. A callbacks system makes it easy to write a real device driver for any platform. The ADFOpus ( http://www.chromerhino.demon.co.uk/adfopus) application (a useful Windows Explorer like for ADF files and devices), written by Dan Sutherland is able to access from Win95/98/NT an 2.5 inches harddisk formatted under AmigaDOS. See the 1.2 section to see how to obtain the package. ------------------------------------------------------------------------ 11. Other Amiga FileSystems * ADFOpus : an 'ADF files explorer', by Dan Sutherland ( http://www.chromerhino.demon.co.uk/adfopus/) * An Amiga filesystem for Linux 0.99pl2 by Ray Burr (read only, hard disk): ftp://tsx-11.mit.edu/pub/linux/patches/amigaffs.tar.Z * The AFFS filesystem inside the Linux kernel distribution by Hans-Joachim "JBHR" Widmaier (RDSK, links and international mode supported, dircache disks read-only): ftp://ftp.us.kernel.org in /usr/src/linux/fs/affs/ * An .ADF manipulation package for DOS/Windows, "ADF-suite" (GUI, Shareware, no sources included): http://www.geocities.com/SiliconValley/Lakes/7094/index.html ------------------------------------------------------------------------ The .ADF format FAQ ends here !